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(54) System and method for encoding/decoding data using multi-stage vector quantisation 



(57) The present method relates to a method for en- 
coding image data using vector quantisation. According 
to the invention, a small first codebook is determined. 
Each image vector of the image data is then encoded 
by determining a codevector within the first codebook 
that best approximates the image vector within the im- 
age data. A first index map is generated by replacing 
each image vector with an index indicative of the code- 
vector's location within the first codebook. Then differ- 
ence data are evaluated based on the original image 
data and the encoded image data. Each error vector of 
the difference data is then encoded using another small 
codebook. In another index map the error vectors are 
then replaced with an index indicative of the codevec- 
tor's location within the other codebook. Evaluation of 
the error based on the difference data and the encoded 
difference data provides new difference data which is 
used to evaluate the fidelity of the approximation proc- 
ess performed for compression. The steps of encoding 
of the difference data are repeated until a control error 
of the difference data is smaller than a given threshold. 
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Description 

Field of the Invention 

5 [0001] This invention relates to data compression and in particular to multidimensional data representations using 
vector quantisation. 

Background of the Invention 

w [0002] The next generation of satellite-based remote sensing instruments will produce an unprecedented volume of 
data. Imaging spectrometers, also known as hyper-spectral imaging devices, are prime examples. They collect image 
data in hundreds of spectral bands simultaneously from the near ultraviolet to the short wave infrared, and are capable 
of providing direct identification of surface materials. 

[0003] Hyper-spectral data thus collected are typically in the form of a three-dimensional (3D) data cube. Each data 
15 cube has two dimensions in the spatial domain defining a rectangular plane of image pixels, and a third dimension in 
the spectral domain defining radiance levels of multiple spectral bands per each image pixel. The volume and com- 
plexity of hyper-spectral data present a significant challenge to conventional transmission and image analysis methods. 
The raw data rates for transmitting such data cubes can easily exceed the available downlink capacity or on-board 
storage capacity of existing satellite systems. Often, therefore, a portion of the data collected on board is discarded 
20 before transmission, by reducing the duty cycle, reducing the spatial or spectral resolution, and/or reducing the spatial 
or spectral range. Obviously, in such cases large amounts of information are lost. 

[0004] For data processing, a similar problem occurs. In computing, a current trend is toward desktop computers 
and Internet based communications. Unfortunately, the data cubes require a tremendous amount of storage and, for 
processing, the storage is preferably random access memory (RAM). Current desktop computers often lack sufficient 
25 resources for data processing of data cubes comprising spectral data. 

[0005] Recent work related to data compression of multi-spectral and hyper-spectral imagery has been reported in 
the literature, but most of these studies relate to multi-spectral imagery comprised of only a few spectral bands. These 
prior art systems for multi-spectral imagery yield small compression ratios, usually smaller than 30:1 . There are two 
reasons for this: 

30 

1 ) the prior art systems do not efficiently remove the correlation in the spectral domain, and 

2) the redundancy of mulli-speclral imagery in the spectral domain is relatively small compared to that of hyper- 
spectral imagery. 

35 

[0006] Gen et al. teach two systems for hyper-spectral imagery. The first system uses trellis coded quantisation to 
encode transform coefficients resulting from the application of an 8 X B X 8 discrete cosine transform. The second system 
uses differential pulse code modulation to spectrally decorrelate data, while using a 2D discrete cosine transform for 
spatial decollation. These two systems are known to achieve compression ratios of greater than 70:1 in some in- 
40 stance; however, it is desirable to have higher compression ratios with simpler coding structures than those reported 
in the literature. 

[0007] In an article entitled "Lossy Compression of Hyperspectral Data Using Vector Quantization" by Michael Ryan 
and John Arnold in the journal RemoteSens. Environ. , Elsevier Science Inc., New York, N.Y., 1997, Vol. 61 , pp. 419-436, 
an overview of general vector quantization techniques as are now known is presented. The article is herein incorporated 
45 by reference. In particular, the authors describe issues such as distortion measures and classification issues arising 
from lossy compression of hyper-spectral data using vector quantization. 

[0008] Data compression using Vector Quantisation (VQ) has received much attention because of its promise of high 
compression ratio and relatively simple structure. Unlike scalar quantisation, VQ requires segmentation of the source 
data into vectors. Commonly, in two-dimensional (2D) image data compression, a block with n x m (n may be equal to 
so m) pixels is taken as a vector, whose length is equal to n x m. Vectors constituted in this way have no physical analogue. 
Because the blocks are segmented according to row and column indices of an image, the vectors obtained in this 
manner change at random as the pixel patterns change from block to block. The reconstructed image shows an explicit 
blocking effect for large compression ratios. 

[0009] There are several conventional approaches to constituting vectors in a 3D data cube of hyper-spectral imagery. 
55 The simplest approach is to treat the 3D data cube as a set of 2D monochromatic images, and segment each mono- 
chromatic image into vectors independently as in the 2D-image case. This approach, however, suffers from not taking 
advantage of the high correlation of data in the spectral domain. There is therefore a need for a data compression 
system that takes advantage of correlation in the spectral domain and the 2D spatial correlation between adjacent 



2 



10/10/2008, EAST Version: 2.3.0.3 



EP1 209 917 A2 



image pixels. 

[0010] The VQ procedure is known to have two main steps: codebook generation and codevector matching. VQ can 
be viewed as mapping a large set of vectors into a small cluster of indexed codevectors forming a codebook. During 
encoding, a search through a codebook is performed to find a best codevector to express each input vector. The index 

5 or address of the selected codevector in the codebook is stored associated with the input vector or the input vector 
location. Given two systems having a same codebook, transmission of the index to a decoder over a communication 
channel from the first system to the second other system allows a decoder within the second other system to retrieve 
the same codevector from an identical codebook. This is a reconstructed approximation of the corresponding input 
vector. Compression is thus obtained by transmitting the index of the codevector rather the codevector itself. Many 

10 existing algorithms for codebook designs are available, such as the LBG algorithm reported by Linde, Buzo and Gray, 
the tree-structure codebook algorithm reported by Gray, the self organising feature map reported by Nasrabadi and 
Feng. Among these, the LBG algorithm is most widely used because of its fidelity. The disadvantages of the LGB 
algorithm are its complexity and the time burden taken to form the codebook. When the input data is a 3D data cube 
of hyper-spectral imagery, the processing time can be hundreds of times higher than the normal 2D-image case. 

15 [0011] It is, therefore, an object of the invention to provide a substantially faster method of compression with a rel- 
atively high fidelity for encoding multidimensional data. 

[0012] It is further an object of the invention to provide a method of encoding multidimensional data in a plurality of 
approximation stages. 

20 Summary of the Invention 

[0013] In accordance with the invention there is provided, a method for encoding image data using vector quantisa- 
tion, wherein the encoded image data is compressed data, the method comprising the steps of: 

25 a) determining a first codebook having a plurality of codevectors; 

b) encoding each image vector of the image data by determining a codevector within the first codebook that ap- 
proximates the image vector within the image data; 

c) creating a first index map by replacing each image vector with an index indicative of the codevector's location 
within the first codebook; 

30 d) determining difference data based on the original image data and the encoded image data; and, 

e) repeating the steps of: 

e1) determining another codebook; 

e2) encoding each error vector of the difference data by determining a codevector within the other codebook 
35 that approximates the error vector within the difference data; 

e3) creating another index map by replacing each error vector with an index indicative of the codevector's 
location within the other codebook; and, 

e4) determining new difference data based on the difference data and the encoded difference data; 

40 until a control error of the difference data is smaller than a given threshold. 

[001 4] In accordance with another aspect of the invention there is provided, a method for transmitting encoded image 
data via a communications network, wherein the encoded image data is compressed data, the method comprising the 
steps of: 

45 

a) receiving from a first station connected to the communications network first data indicative of a first codebook 
and a first index map: 

b) transmitting the first data via the communications network from the first station to a second station; and, 

c) repeating the steps of: 

d) receiving data indicative of a consecutive codebook and a consecutive index map; and, 

c2) transmitting the data via the communications network from the first station to the second station; 

until a fidelity of an image reconstructed from the transmitted data at the second station is above a prede- 
55 termined threshold or until all codebooks and all index maps of the encoded image data have been transmitted. 

[0015] In accordance with yet another aspect of the invention there is provided, a method for decoding encoded 
image data, wherein the encoded image data is compressed data, the method comprising the steps of: 
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a) decoding each encoded image vector of the image data using a first codebook and a first index map; 

b) reconstructing first image data based on the decoded image vectors; and, 

c) repeating the steps of: 

5 d) decoding each encoded error vector of consecutive difference data using a consecutive codebook and a 

consecutive index map; and, 

c2) reconstructing image data based on the first image data and the decoded error vectors of consecutive 
difference data; 

10 until a fidelity of the reconstructed image data is above a predetermined threshold or until all codebooks and 

all index maps of the encoded image data have been decoded. 

[0016] In accordance with the invention there is further provided, a system for encoding image data using vector 
quantisation, wherein the encoded image data is compressed data, the system comprising: 

a first port for receiving the image data; 
a processor for: 

a) determining a first codebook having a plurality of codevectors; 
20 b) encoding each image vector of the image data by determining a codevector within the first codebook that 

approximates the image vector within the image data; 

c) creating afirst index map by replacing each image vector with an index indicative of the codevector's location 
within the first codebook; 

d) determining difference data based on the original image data and the encoded image data; and, 
25 e) repeating the steps of: 

e1) determining another codebook; 

e2) encoding each error vector of the difference data by determining a codevector within the other code- 
book that approximates the error vector within the difference data; 
30 e3) creating another index map by replacing each error vector with an index indicative of the codevector's 

location within the other codebook; and, 

e4) determining new difference data based on the difference data and the encoded difference data; 

until a control error of the difference data is smaller than a given threshold; memory forstoring data during execution 
35 of steps a) to e4); and, a second port for providing the encoded image data. 

[0017] In accordance with the invention there is yet further provided, a system for decoding encoded image data, 
wherein the encoded image data is compressed data, the system comprising: 

40 a first port for receiving the encoded image data; 

a processor for: 

a) decoding each encoded image vector of the image data using a first codebook and a first index map; 

b) reconstructing first image data based on the decoded image vectors; and, 
45 c) repeating the steps of: 

c1) decoding each encoded error vector of consecutive difference data using a consecutive codebook 
and a consecutive index map; and, 

c2) reconstructing image data based on the first image data and the decoded error vectors of consecutive 
so difference data; 

until a fidelity of the reconstructed image data is above a predetermined threshold or until all codebooks and all 
index maps of the encoded image data have been decoded; 
memory for storing data during execution of steps a) to c2); and, 
55 a second port for providing the decoded image data. 
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Brief Description of the Drawings 

[0018] Exemplary embodiments of the invention will now be described in conjunction with the drawings, in which: 

5 Fig. 1 is a perspective view of a hyper-spectral data cube having two dimensions in the spatial domain defining a 

rectangular plane of image pixels, and a third dimension in the spectral domain defining radiance levels of multiple 
spectral bands per each image pixel; 

Fig. 2 is a simplified block diagram of a prior art embodiment of a system for compressing, communicating and 
processing in a compressed form, hyper-spectral image data defining radiance levels of multiple spectral bands 
10 per image pixel, said system being initially trained with image data defining a predetermined set of training image 

pixels; 

Fig. 3 is a flow diagram of a preferred embodiment of a method for encoding image data according to the invention; 
Fig. 4 is a simplified diagram of the method shown in Fig. 3; 

Fig. 5 is simplified diagram of a system for encoding image data according to the invention; 
15 Fig. 6 is a simplified diagram of a method for transmitting encoded image data according to the invention; 

Fig. 7 is a simplified diagram of a method for decoding encoded image data according to the invention; and, 
Fig. 8 is simplified diagram of a system for decoding encoded image data according to the invention. 

Detailed Description of the Invention 

20 

[0019] In spectral imaging using satellite based hyperspectrat imagers, there is a tremendous amount of data cap- 
tured that requires transmission to a terrestrial base for analysis and other uses. Typically it is desirable to compress 
the captured data before transmitting same to the ground. Unfortunately, this often requires complex and expensive 
compression hardware. Using the method of the present invention, it is possible to implement a fast data encoding 
25 system using commonly available processors that operates in real-time and is suitable to installation on board a satellite 
system. 

[0020] Referring now to Fig. 1 , a hyper-spectral data cube is shown. The data is a set of spectral data captured from 
a satellite. As such, there is a strong correlation between spectra of similar items such as snow or water. For example, 
spectra relating lo locations wherein snow is found are often similar, but not identical. Encoding of these data in order 

30 to compress them can be performed using a vector quantisation (VQ) method. Referring to Fig. 2, a simplified flow 
diagram of a prior art method of performing vector quantisation is shown. A codebook is generated from a hyper- 
spectral datacube having a known number of codevectors Generation of a codebook is a time-consuming and difficult 
task since the ability of the codevectors within the codebook to approximate each vector in the datacube is essential 
in order to provide a good fidelity - minimal error. Thus, a set of codevectors within the codebook is selected and 

35 compared against vectors in the datacube to ensure that they "best" approximate each vector in some fashion, 

[0021] Once the codebook is generated, the vectors within the datacube are encoded by replacing each vector with 
an index of the best matching codevector within the codebook. For example, when a datacube has 1 ,000,000 vectors 
and a codebook has 256 codevectors, the resulting compressed data requires memory for 256 vectors being the 
codebook and 1 ,000,000 bytes forming the entire array of indices. Even if the codevectors have 100 bytes each, the 

40 resulting encoded data requires just over a megabyte while the original data required 1 00 megabytes. However, though 
the compression ratio is high, the fidelity may be poor since the compression is lossy. Further, different codebooks will 
result in different - better or worse - fidelity as noted above. 

[0022] In order to overcome the shortcomings of the above method a Successive Approximation Multi-stage Vector 
Quantisation (SAMVQ) method for encoding multidimensional data is disclosed. Throughout the specification and 

45 claims the term image data is defined to mean any multidimensional data. Referring to Figs. 3, 4 and 5, a system 1 00 
and a method for encoding hyper-spectral data according to the invention is shown. The original image data is provided 
via port 101 as input to processor 103 for successive approximation multi-stage processing as shown in Figs. 3 and 
4. Memory 105, preferably RAM, is provided to store data during the processing. Encoded data are then provided to 
port 107 connected to a communications network. 

so [0023] In a first approximation stage, a first codebook having a small number of codevectors is generated from the 
original image data. A codevector in the codebook corresponds to a cluster of image vectors and is the gravity center 
of the cluster. The codebook typically has less than 16 codevectors. Selection of such a codebook to accurately reflect 
the vectors of a given datacube is unlikely and as such, less care needs to betaken to ensure high fidelity of the results. 
Optionally, sampling is performed on a small percentage of image vectors with in the image data and a set of codevectors 

55 is determined for reasonably approximating the sampled vectors. Next, the image vectors of the image data are encoded 
using the small first codebook by determining a codevector within the first codebook that approximates the image 
vector within the image data, and preferably that best approximates the image vector. Generation of a first index map 
replaces each image vector with an index indicative of thecodevector's location within the first codebook. As is evident, 
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encoding the image data with a small codebook will result in encoded data having a low fidelity. In preparation of a 
following approximation stage difference based on the original image data and the encoded image data are determined. 
The difference data is obtained as a difference between the original image data and reconstructed image data after 
some form of decoding. The difference data become input data for a subsequent approximation stage. In the second 

5 subsequent approximation stage a new approximation is created by generating a new small codebook and encoding 
each error vector of the difference data by determining a codevector within the new small codebook that approximates 
the error vector within the difference data. A second index map is created by replacing the error vectors with an index 
indicative of the codevector's location within the new small codebook. New difference data based on the original image 
data, the encoded image data and the encoded difference data are then determined. Of course, given an accurate 

10 representation of the difference data of a previous iteration allows a simple comparison between the actual error and 
the encoded value for the error to determine the new difference data. The approximation stages comprising the en- 
coding of the difference data is continued until a control error of the difference data is smaller than a given threshold. 
[0024] Optionally, sampling is performed on a small percentage of image vectors within the original image data and 
a set of codevectors is determined for reasonably approximating the sampled vectors. Further optionally, sampling is 

15 also performed on the error vectors for reasonably approximating the error vectors. Accurate sampling may result in 
a substantial reduction of the number of approximation stages and/or sizes of the codebooks. 
[0025] The compression ratio of the SAMVQ method according to the invention with m -stage approximation of a 
hyper-spectral datacube is expressed as: 

20 

N-N-N b - Len 
Cr= -jj > 

£ (N m -N b -Len + N r -N c -\°g 2 Nj 

25 

where N r and N c \s the number of lines and the number of pixels in the scene of the hyper-spectral datacube, N b is the 
number of spectral bands, Len is the word-length of data value, N m is the size of the codebook at stage m and M is 
the number of approximation stages. 
30 [0026] Codebook Generation Time (CGT) is much faster than with conventional vector quantisation methods, since 
the codebook at each approximation stage is much smaller. To generate a codebook for a given datacube, the CGT 
is proportional to the size of the codebook, In conventional vector quantisation methods a single codebook of size N 
is generated. The CGT is proportional to N : 

CGT (3DVQ } ~ N • 

whereas for the SAMVQ method according to the invention the CGT is proportional to the cumulative sum of the sizes 
of the codebooks generated at each approximation stage: 

M 

CGT(SAMVQ) azN'= ^N m , 

45 

where N m is the size of the codebook for the m th stage. In general, N m « N . Since Coding Time (CT) and decoding 
time are also proportional to the codebook size the coding and the decoding are much faster for the SAMVQ method 
than conventional vector quantisation methods. This improvement in processing speed has no fidelity penalty, because 
the SAMVQ method spans the data with a virtual codebook proportional to the product of the sizes of the codebooks 
so generated at each approximation stage. Therefor, the size of the virtual codebook is: 



55 




For example, assume that the SAMVQ method comprises a 4 stage approximation with codebooks having identical 
size of 8 codevectors at each stage. Then the virtual codebook - the equivalent codebook for conventional vector 
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quantisation methods - would have N = 84 = 4096codevectors to achieve the same reconstruction fidelity as the SAM VQ 
method having only /V = 4 x 8 codevectors. Both the CGT and the CT are improved by a factor of 



[0027] By varying the size of the codebook used at each approximation stage and the number of approximation 
stages the compression ratio of the encoding as well as the fidelity of the reconstructed data is controllable. Therefore, 
the SAMVQ method according to the invention is highly advantageous for various applications. 
[0028] The set of codebooks and index maps of the multiple approximation stages is easily combined into a single 
codebook and a single index map similar to those obtained from conventional vector quantasation methods. For ex- 
ample a single index map is optionally constructed by concatenating the indices indicating a same spatial location in 
the index maps allowing fast calculation of a corresponding combined codevector for decoding. 
[0029] The compression ratio obtained by the SAMVQ method is optionally further improved without affecting fidelity 
by entropy encoding of the codebook and the index map at each approximation stage. The amplitude of the codevectors 
decreases with increasing number of approximation stages. For example, the amplitude of each codevector after the 
second approximation stage may occupy only the least 4 bits. Using entropy encoding the codevectors after stage two 
are expressed using only the lowest order 4 bits instead of the usual word length Len of 16 bits. 
[0030] Another highly advantageous feature of the SAMVQ method is the creation of encoded data - codebook and 
index map - in subsequent approximation stages. This allows encoding, transmission and decoding of same original 
image data in stages of increasing reconstruction fidelity. For example, the most significant image information is en- 
coded, transmitted and decoded first followed subsequently by lesser significant image information. 
[0031] Furthermore, if the number of codevectors in the first codebook is determined such that it is close to the 
number of real classes present in the image data comprising a hyper-spectral datacube then the first index map provides 
spatial information and spectral classification information of the hyper-spectral datacube. 

[0032] Referring to Figs. 6 and 7 flow charts are shown outlining a very elegant method for transmission and decoding 
according to the invention. Fig. 8 is a simplified diagram of a system for decoding compressed data according to the 
invention. Data indicative of a first codebook and a first index map are received from a first station connected to a 
communications network and transmitted to a second station connected to the communications network. Codebooks 
and index maps created in each of subsequent approximation steps are then transmitted subsequently. The transmis- 
sion is terminated when all codebooks and all index maps of the encoded image data have been transmitted. Alterna- 
tively, the second station may terminate transmission if an image reconstructed from the transmitted data has fidelity 
above a predetermined threshold, which is less than the threshold of the encoded data at the first station. Further 
alternatively, the first station may terminate the transmission if image data of only lesser fidelity should be provided to 
the second station. Preferably, the most significant image information is transmitted first. 

[0033] The encoded data are received from a commu nications network at port 201 of system 200 as input to processor 
203 for multi-stage decoding as shown in Figs. 7 and 8. Memory 205, preferably RAM, is provided to store data during 
the processing. Decoded and reconstructed image data are then provided to port 207. The received data are decoded 
in a first stage based on data indicative of a first codebook and a first index map providing decoded image vectors. In 
successive stages each encoded error vector of consecutive difference data is decoded using a consecutive codebook 
and a consecutive index map. Image data of increasing fidelity are then consecutively reconstructed based on con- 
secutive error vectors of successive approximation stages. The successive stages of decoding are continued until 
fidelity of the reconstructed image data is above a predetermined threshold or until all codebooks and index maps have 
been decoded. 

[0034] The SAMVQ method for encoding and its embodiments for transmission and decoding are highly advanta- 
geous for applications in air- and spacecraft, for example, for earth observation. In particular, the unique features of 
this method - successive stages of approximation and speed - allow the application of compression technology in real 
time on board an air - or spacecraft. Creation of encoded data - codebook and index map - in subsequent approximation 
stages allows encoding, transmission and decoding in real time of same original image data in stages of increasing 
reconstruction fidelity with the most significant image information being encoded, transmitted and decoded first, fol- 
lowed subsequently by lesser significant image information. For example, this allows termination of transmission of 
data if a reconstructed image has sufficient fidelity, freeing precious bandwidth for transmission of other data. 
[0035] Another application of this highly advantageous method is the provision of image data - pictures, videos etc. 
- from a providerto a client via a communications network such as the Internet. The client receives compressed image 
data of low fidelity, for example, a first codebook and a first index map for viewing. After the client made a selection 
he contacts the providerto order image data he has selected. The provider then supplies data indicative of codebooks 
and index maps of successive approximation stages of the selected image data in order to reconstruct image data of 
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higher fidelity. 

[0036] Though in the above description, the exact method of determining codevectors within a codebook is not dis- 
closed, there are many such methods in the prior art. Any such method is applicable to the present invention. Preferably, 
such a method is applied in a more time efficient fashion that risks fidelity in order to improve performance. Since 

5 fidelity will be improved in further stages, the fidelity of each individual stage is less significant than with the prior art. 
[0037] For example, a method of fast vector quantisation involves a step of training set sub-sampling. Such a method, 
when integrated into the present inventive method, results in significant advantages. It is generally known that to gen- 
erate a given size codebook the Codebook Generation Time (CGT) is proportional to the size of the training set. The 
CGT at each stage of the present inventive method is improved by a factor of approximately 1/sampling rate (SR), if 

10 the training set is sub-sampled at a rate of SR. For example, if the training set consists of only 2% of the vectors within 
the datacube, the CGT is improved by a factor of approximately 50. For an iterative or recursive method such as the 
present invention, the speed improvement is very significant since numerous codebooks are generated in the vector 
quantisation of a single datacube. 

[0038] The overall processing time of the present algorithm with sub-sampling is comparable to the fastest Multiple 
15 Sub-Codebook Algorithm (MSCA). The processing times are similar. Since for both algorithms the codebook generation 
time decreases when the training set size and the codebook size are reduced this is expected. Further, the coding time 
is reduced when the codebook size is decreased. The distinguishing feature of the present invention is a resulting 
improved fidelity, improved compression ratio, and an ability to selectively trade-off between these two measures of 
performance either prior to processing or from the compressed data. 
20 [0039] Of course, the present invention will also function with any of a variety of methods of codebook generation 
such as the LBG method, the Spectral Feature Based Binary Coding method, and MSCA. 

[0040] Also, during an encoding step, the SFBBC method and the Correlation Vector Quantization (CVQ) method 
are suitable alternatives to the LBG algorithm. When using MSCA, it is suitable for replacing both the codebook gen- 
eration and the encoding steps. 

25 [0041] Selection of codebook generation techniques and of encoding techniques within the framework of the inventive 
method is a matter for one skilled in the art based on design parameters relating to system performance and based 
on their available working program code. For example, someone with working code for performing MSCA may choose 
to use MSCA for both steps to obviate a need to further develop encoding and codebook selection code, thereby 
speeding up Lime to market. Of course, numerous parameters effect selection of techniques within the inventive method. 

30 This is evident to those of skill in the art, 

[0042] According to an embodiment of the invention a fixed fidelity is provided at an outset of the compression proc- 
ess. For example, the fidelity is provided as a signal to noise ratio. The compression process them proceeds through 
a surricienl number of stages until the reconstruction fidelity reaches the predetermined fixed fidelity. In one embodiment 
the algorithm adaptively selects the codebook size at each approximate stage to yield a best compression ratio and 

35 fastest processing time. This mode has been examined and demonstrated on 8 hyperspectral test data sets. Alterna- 
tively, a same codebook size is used for each stage. 

[0043] Lossy compression can be treated as lossless or near-lossless compression from the point of view of appli- 
cations, if the level of noise (error) introduced by a lossy compressor is smaller than that of the intrinsic noise of the 
original data. In using the Fixed Fidelity mode, one can implement near lossless compression by setting the value of 
40 the fidelity threshold to be slightly less than the signal-to-noise ratio of the original data. Of course, in transmitting the 
data, only an amount of data with a desired fidelity need be transmitted to allow reconstruction of the data with that 
fidelity. This provides flexibility with approximately lossless data storage. 

[0044] In another embodiment, an operating mode called Asymptotic Compression Ratio Estimation is provided. A 
graph of fidelity versus compression ratio, which is related to the number of approximation stages and codebook size 

45 at each stage, statistically reaches an asymptote. Despite an increasing number of approximation stages, after a certain 
number of stages the reconstruction fidelity ceases to increase as the compression ratio decreases. This point, which 
is referred to as an inflection point of the graph is detected, and compression proceeds automatically stage by stage 
until the inflection point is detected. In addition the process adaptively selects codebook size at each stage to yield a 
best compression ratio and fastest processing time. This mode has been examined and demonstrated on 8 hyper- 

50 spectral test data sets. Alternatively, after a number of stages the compression ration decreases while the fidelity 
improves only nominally defining the inflection point. Clearly, using such a process allows for a careful balance between 
compression ratio and fidelity. 

[0045] In an embodiment in the process of providing a fixed fidelity and/or in the process of detecting the inflection 
point, the fidelity of each spectral band is analysed rather than the fidelity of the overall spectral bands. If a spectral 
55 band is detected whose fidelity has reached the desirable fidelity or the inflexion point, the process of coding to reach 
a predetermined fidelity and/or the process of automatic detection of the inflection point operate on a set of codevectors 
excluding this spectral band. This process guarantees that the fidelity of the reconstructed data is better than the 
predetermined fidelity in each spectral band. Due to the fact that the convergence rate of each band to the predeter- 
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mined fidelity is different, the bands whose convergence rate is fast are excluded from processing of further iterations, 
which will include those bands whose convergence rate is slower. This saves processing time for both codebook gen- 
eration and encoding. For automatic detection of the inflection point, this process produces an inflection point for each 
spectral band, and continues to iterate on spectral bands whose inflexion points have not been detected. An overall 

5 inflection point is obtained by averaging the inflection points at each spectral band. Besides saving processing time 
for both codebook generation and coding, this process produces a higher compression ratio compared to the ordinary 
method which verifies the fidelity of the overall spectral bands. This is evident since it avoids further iterations on 
spectral bands whose inflection points have been reached - whose fidelity is not improving through iteration. 
[0046] For example, when inflection points are detected for half of the bands, the compression process is iterating 

10 on half of the total number of bands. As such, there are fewer vectors and compression time is reduced and/or com- 
pression quality per iteration is improved. 

[0047] EINBETTENOf course, numerous other embodiments may be envisaged without departing from the spirit and 
scope of the claimed invention. 



1. A method for encoding image data using vector quantisation, wherein the encoded image data is compressed 
data, the method comprising the steps of: 

a) determining a first codebook having a plurality of codevectors; 

b) encoding each image vector of the image data by determining a codevector within the first codebook that 
approximates the image vector within the image data; 

c) creating a first index map by storing associated with each of the image vectors an index indicative of the 
codevector's location within the first codebook; 

d) determining difference data based on the original image data and the encoded image data; and, 

e) repeating the steps of: 

e1) determining another codebook; 

e2) encoding each error vector of the difference data by determining a codevector within the other code- 
book that approximates the error vector within the difference data; 

e3) creating another index map by storing associated with each of the error vectors an index indicative of 
the codevector's locaLion within the other codebook; and, 

e4) determining new difference data based on difference data and the encoded difference data; 
until a control error of the difference data is smaller than a given threshold. 

2. A method for encoding image data using vector quantisation as defined in claim 1 , wherein step a) comprises the 
steps of sampling a small subset of vectors within the image data and determining a set of codevectors for rea- 
sonably approximating the sampled vectors. 

3. A method for encoding image data using vector quantisation as defined in claim 2, wherein sampling is performed 
on a small percentage of vectors within the image data. 

4. A method for encoding image data using vector quantisation as defined in claim 1 , wherein step e1) comprises 
the steps of sampling a small subset of error vectors within the difference data and determining a set of codevectors 
for reasonably approximating the sampled vectors. 

5. A method for encoding image data using vector quantisation as defined in claim 1 , wherein step d) comprises the 
step of decoding the encoded image data and wherein the difference data are determined as a difference between 
the original image data and the decoded image data. 

6. A method for encoding image data using vector quantisation as defined in claim 1 , wherein step d) comprises the 
step of subtracting one of an original image vector and a codevector associated with the image vector by the 
associated index value from the other. 

7. A method for encoding image data using vector quantisation as defined in claim 1 , wherein a compression ratio 
of the encoding is controlled by the size of the codebook at each approximation stage comprising steps (e1)to (e4). 
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8. A method for encoding image data using vector quantisation as defined in claim 7. wherein a codebook size is 
varied between iterations. 



9. A method for encoding image data using vector quantisation as defined in claim 1 , wherein a compression ratio 
of the encoding is controlled by the number of approximation stages, wherein each approximation stage comprises 
steps (e1) to (e4). 

10. A method for encoding image data using vector quantisation as defined in claim 1 , wherein fidelity of the encoded 
image data is controlled by the size of the codebook at each approximation stage comprising steps (e1) to (e4). 

11. A method for encoding image data using vector quantisation as defined in claim 10, wherein a codebook size is 
varied between iterations. 



12. A method for encoding image data using vector quantisation as defined in claim 1 . wherein fidelity of the encoded 
15 image data is controlled by the number of approximation stages, each approximation stage comprising steps e1) 

to e4). 

13. A method for encoding image data using vector quantisation as defined in claim 1 , comprising the steps of: 

20 combining the first codebook and the other codebooks into a single codebook; and, 

combining the first index map and the other index maps into a single index map. 

14. A method for encoding image data using vector quantisation as defined in claim 13, wherein the combined single 
index map is constructed by concatenating the indices indicating a same location in the index maps. 

25 

15. A method for encoding image data using vector quantisation as defined in claim 1 , wherein image information is 
encoded in dependence upon its significance such that most significant image information is encoded first. 

16. A method for encoding image data using vector quantisation as defined in claim 1 , wherein the codebooks and 
30 index maps are entropy encoded. 

1 7. A method for encoding image data using vector quantisation as defined in claim 1 , wherein the image data comprise 
a hyper-specLral dalacube and wherein the number of codevectors in the first codebook is determined such that 
it is close to the number of real classes present in the image. 

35 

18. A method for encoding image data using vector quantisation as defined in claim 17, wherein the first index map 
provides spatial information and spectral classification information of the hyper-spectral datacube. 

19. A method for encoding image data using vector quantisation as defined in claim 1 , wherein at least one of steps 
40 (a) and (e1) are performed by at least one of the following: LBG, SFBBC, and MSCA. 

20. A method for encoding image data using vector quantisation as defined in claim 19, wherein at least one of steps 
(b) and (e2) are performed by at least one of the following: CVQ, SFBBC, and MSCA. 

45 21 . A method for encoding image data using vector quantisation as defined in claim 1 , wherein between each iteration 
a determination is made of an improvement in fidelity and wherein the method is halted when the improvement in 
fidelity of a single iteration is below a threshold improvement. 

22. A method for encoding image data using vector quantisation as defined in claim 1 , wherein between each iteration 
so a determination is made of an improvement in fidelity for each spectrum and wherein spectra for which the im- 
provement in fidelity of a single iteration is below a threshold improvement are excluded from a dataset for process- 
ing in subsequent iterations. 

23. A method for encoding image data using vector quantisation as defined in claim 22, wherein spectra for which the 
55 improvement in fidelity of a single iteration is below a threshold improvement are determined based on a closeness 

of the error vector associated with the spectrum to the actual error spectrum. 

24. A method for encoding image data using vector quantisation as defined in claim 1 , wherein between each iteration 
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a determination is made of a fidelity of the encoded data and wherein the method is halted when the fidelity of the 
encoded data is better than a predetermined fixed fidelity. 

25. A method for encoding image data using vector quantisation as defined in claim 24, wherein the predetermined 
fixed fidelity is approximately a same level of fidelity as that provided by a transducer with which the spectra were 



26. A method for encoding image data using vector quantisation as defined in claim 1 , between each iteration a de- 
termination is made of a fidelity of the encoded data for each spectrum and wherein spectra for which the fidelity 
of the encoded data is better than a predetermined fixed fidelity are excluded from a dataset for processing in 
subsequent iterations. 

27. A method for encoding image data using vector quantisation, wherein the encoded image data is compressed 
data, the method comprising the steps of: 



a) determining a first codebook having a plurality of codevectors; 

b) encoding each image vector of the image data by determining a codevector within the first codebook that 
approximates the image vector within the image data; 

c) creating a first index map by storing associated with each of the image vectors an index indicative of the 
20 codevector's location within the first codebook; 

d) determining difference data based on the original image data and the encoded image data; and, 

e) iterating the steps of: 

e1) determining another codebook; 
25 e2) encoding each error vector of the difference data by determining a codevector within the other code- 

book that approximates the error vector within the difference data; 

e3) creating another index map by storing associated with each of the error vectors an index indicative of 
the codevector's location within the other codebook; and, 

e4) determining new difference data based on the difference data and the encoded difference data; 

30 

until a predetermined number of iterations are completed. 



28. A melhod for encoding image dala using vector quantisation as defined in claim 27, wherein step a) comprises 
the steps of sampling a small subset of vectors within the image data and determining a set of codevectors for 

35 reasonably approximating the sampled vectors. 

29. A method for encoding image data using vector quantisation as defined in claim 28, wherein sampling is performed 
on a small percentage of vectors within the image data. 

40 30. A method for encoding image data using vector quantisation as defined in claim 27, wherein step e1) comprises 
the steps of sampling a small subset of error vectors within the difference data and determining a set of codevectors 
for reasonably approximating the sampled vectors. 

31. A method for transmitting encoded image data via a communications network, wherein the encoded image data 
45 is compressed data, the method comprising the steps of: 

a) receiving from a first station connected to the communications network first data indicative of a first codebook 
and a first index map: 

b) transmitting the first data via the communications network from the first station to a second station; and, 
so c) repeating the steps of: 

c1) receiving data indicative of a consecutive codebook and a consecutive index map; and, 

c2) transmitting the data via the communications network from the first station to the second station; 

55 until a fidelity of an image reconstructed from the transmitted data at the second station is above a 

predetermined threshold or until all codebooks and all index maps of the encoded image data have been 
transmitted. 
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32. A method for transmitting encoded image data via a communications network as defined in claim 31 , wherein 
image information is transmitted in dependence upon its significance such that most significant image information 
is transmitted first. 

5 33. A method for transmitting encoded image data via a communications network as defined in claim 31 , wherein the 
communications network comprises a wireless communications network. 

34. A method for transmitting encoded image data via a communications network as defined in claim 31 , wherein the 
communications network comprises the Internet. 

35. A method for decoding encoded image data, wherein the encoded image data is compressed data, the method 
comprising the steps of: 

a) decoding each encoded image vector of the image data using a first codebook and a first index map; 
15 b) reconstructing first image data based on the decoded image vectors; and, 

c) repeating the steps of: 

c1) decoding each encoded error vector of consecutive difference data using a consecutive codebook 
and a consecutive index map; and. 
20 c2) reconstructing image data based on the first image data and the decoded error vectors of consecutive 

difference data; 

until a fidelity of the reconstructed image data is above a predetermined threshold or until all codebooks 
and all index maps of the encoded image data have been decoded. 

25 

36. A method for decoding encoded image data as defined in claim 35, wherein the threshold for the fidelity of the 
reconstructed image data is smaller than the threshold for the fidelity of the encoded image data. 

37. A method for decoding encoded image data as defined in claim 35, wherein image information is reconstructed in 
so dependence upon its significance such that most significant image information is reconstructed first. 

38. A system for encoding image data using vector quantisation, wherein the encoded image data is compressed data, 
the system comprising: 

35 a first port for receiving the image data; 

a processor for: 

a) determining a first codebook having a plurality of codevectors; 

b) encoding each image vector of the image data by determining a codevector within the first codebook 
40 that approximates the image vector within the image data; 

c) creating a first index map by storing associated with the image vectors an index indicative of the code- 
vector's location within the first codebook; 

d) determining difference data based on the original image data and the encoded image data; and, 

e) repeating the steps of: 

45 

e1) determining another codebook; 

e2) encoding each error vector of the difference data by determining a codevector within the other 
codebook that approximates the error vector within the difference data; 

e3) creating another index map by storing associated with the error vectors an index indicative of the 
so codevector's location within the other codebook; and, 

e4) determining new difference data based on the difference and the encoded difference data; 

until a control error of the difference data is smaller than a given threshold; 

memory for storing data during execution of steps a) to e4); and, a second port for providing the encoded 
55 image data. 

39. A system for encoding image data using vector quantisation as defined in claim 38, wherein the image data are 
encoded in real time. 
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40. A system for encoding image data using vector quantisation as defined in claim 38, wherein image information is 
encoded in dependence upon its significance such that most significant image information is encoded first. 

41. A system for decoding encoded image data, wherein the encoded image data is compressed data, the system 
5 comprising: 

a first port for receiving the encoded image data; 
a processor for: 

10 a) decoding each encoded image vector of the image data using a first codebook and a first index map; 

b) reconstructing first image data based on the decoded image vectors; and, 

c) repeating the steps of: 

d ) decoding each encoded error vector of consecutive difference data using a consecutive codebook 
15 and a consecutive index map: and. 

c2) reconstructing image data based on the first image data and the decoded error vectors of con- 
secutive difference data; 

until a fidelity of the reconstructed image data is above a predetermined 

20 

threshold or until all codebooks and all index maps of the encoded image data have been decoded; 
memory for storing data during execution of steps a) to c2); and, 
a second port for providing the decoded image data. 

25 42. A system for decoding encoded image data as defined in claim 41 , wherein the image data are decoded in realtime. 

43. A system for decoding encoded image data as defined in claim 41 , wherein image information is received in de- 
pendence upon its significance such that most significant image information is received first. 

30 44. A system for decoding encoded image data as defined in claim 41 , wherein image information is reconstructed in 
dependence upon its significance such that most significant image information is reconstructed first. 

45. A system for decoding encoded image data as defined in claim 41, wherein the threshold for the fidelity of the 
reconstructed image data is smaller than the threshold for the fidelity of the encoded image data. 
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a) determining a first codebook having a plurality of codevectors 






b) encoding each image vector of the image data by determining a 
codevector within the first codebook that approximates the image vector 
within the image data 




T 


c) creating a first index map by replacing the image vectors with an 
index indicative of the codevector's location within the first codebook 




T 


d) determining difference data based on the original image data and the 
encoded image data 






« 


el) determining another codebook 


^ 


f 


el) encoding each error vector of the difference data by determining a 
codevector within the other codebook that approximates the error vector 
within the difference data 




r 


e3) creating another index map by replacing the error vectors with an 
index indicative of the codevector's location within the other codebook 


1 


e4) determining new difference data 
the encoded image data and the enc 


based on the original image data, 
ded difference data 



Figure 4 



Repeat until a control error 
of the difference data is 
smaller than a given 
threshold 
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101 





103 



a) determining a first codebook having a plurality of codevectors; 

b) encoding each image vector of the image data by determining a codevector 
within the first codebook that approximates the image vector within the image data; 

c) creating a first index map by replacing the image vectors with an index 
indicative of the codevector's location within the first codebook; 

d) determining difference data based on the original image data and the encoded 
image data; and, 

e) repeating the steps of: 

el) determining another codebook; 

eZ) encoding each error vector of the difference data by determining a 
codevector within the other codebook that approximates the error vector 
within the difference data; 

e3) creating another index map by replacing the error vectors with an 
index indicative of the codevector's location within the other codebook; 
and, 

e4) determining new difference data based on the difference data and the 
encoded difference data; 
until a control error of the difference data is smaller than a given threshold; 
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ENCODED IMAGE DATA 



Figure 5 
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ENCODED IMAGE DATA 



a) receiving from a first stati 
communications network fir 
codebook and a first index rr 


on connected to the 
t data indicative of a first 
ap 






b) transmitting the first data 
from the first station to a sec 


via the communications network 
ond station 



Figure 6 



cl) receiving data indicative of a consecutive codebook and 
a consecutive index map 




r 


c2) transmitting the data via 
from the first station to the s 


the communications network 
2cond station 



Repeat until a fidelity of 
an image reconstructed 
from the transmitted data 
at the second station is 
above a predetermined 
threshold or until all 
codebooks and all index 
maps of the encoded 
image data have been 
transmitted 
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ENCODED IMAGE DATA 



Figure 7 



a) decoding each encoded image vector of the image data 
using a first codebook and a first index map 




r 


b) reconstructing first image 
image vectors 


data based on the decoded 



cl) decoding each encoded error vector of consecutive 
error data using a consecutive codebook and a consecutive 
index map 



c2) reconstructing image data based on the first image data 
and the decoded error vectors of consecutive error data 



Repeat until a fidelity 
of the reconstructed 
image data is above a 
predetermined 
threshold or until all 
codebooks and all 
index maps of the 
encoded image data 
have been decoded 
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ENCODED IMAGE DATA 
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a) decoding each encoded image vector of the image data using a 
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first codebook and a first index map; 

b) reconstructing first image data based on the decoded image 
vectors; and, 

c) repeating the steps of: 

cl) decoding each encoded error vector of consecutive 
difference data using a consecutive codebook and a 
consecutive index map; and, 

c2) reconstructing image data based on the first image 
data and the decoded error vectors of consecutive error 
data; 

until a fidelity of the reconstructed image data is above a 
predetermined threshold or until all codebooks and all index 
maps of the encoded image data have been decoded; 
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